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ON MARTINGALE APPROXIMATIONS 1 

By Ou Zhao and Michael Woodroofe 
Yale University and University of Michigan 

Consider additive functionals of a Markov chain Wk, with station- 
ary (marginal) distribution and transition function denoted by tt and 
Q, say S n = g(Wi) + ■ ■ •+g(W n ), where g is square integrable and has 
mean with respect to tt. If S n has the form S„ = M n + R n , where 
M n is a square integrable martingale with stationary increments and 
E(R„) = o(n), then g is said to admit a martingale approximation. 
Necessary and sufficient conditions for such an approximation are de- 
veloped. Two obvious necessary conditions are E[E(S n \ Wi) 2 ] = o(n) 
and linin^oo E(S 2 )/n < oo. Assuming the first of these, let \\g\\ + = 
limsup n _ rao E(S n ) /n; then || • ||+ defines a pseudo norm on the sub- 
space of L 2 (n) where it is finite. In one main result, a simple necessary 
and sufficient condition for a martingale approximation is developed 
in terms of || ■ || + . Let Q* denote the adjoint operator to Q, regarded 
as a linear operator from L 2 (tt) into itself, and consider co-isometries 
(QQ* = /), an important special case that includes shift processes. In 
another main result a convenient orthonormal basis for Lq(tt) is iden- 
tified along with a simple necessary and sufficient condition for the 
existence of a martingale approximation in terms of the coefficients 
of the expansion of g with respect to this basis. 

1. Introduction. Some notation is necessary to describe the results of the 
paper. Let . . . , W_i, Wo, W\, . . . denote a stationary, ergodic Markov chain 
with values in a measurable space W. The marginal distribution and transi- 
tion function of the chain are denoted by it and Q; thus, tt{B} = P[W n £ B] 
and Q(w;B) = P[W n+ i £ B\W n = w] for w G W and measurable sets B C 
W. In addition, Q denotes the operator, defined by 

Qf{w)= I f(z)Q{w;dz) a.e. (vr) 
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for / G L 1 (71") , and the iterates of Q are denoted by Q k = Q o ■ ■ ■ o Q (k times) . 
Thus, Q k f{w) = E[f(W n+k )\W n = w] a.e. (vr) for / G L 1 ^). The probability 
space on which . . . , W-i, Wo, W±, . . . are defined is denoted by (Q,A, P), and 
Fn = °"{- ■ • > W n —i, W n }. Finally, || • || and (•,•) denote the norm and inner 
product in an I? space, which may vary from one usage to the next. 

Observe that no stringent conditions, like Harris recurrence or even irre- 
ducibility, have been placed on the Markov chain. In particular, if ... , £o, 
are i.i.d. with common distribution p, say, then the shift process 
Wk = (..., £fc-i> 6c) satisfies the conditions placed on the chain with ir = p N , 
where N = {0, 1,2,.. .}, and Qg{w) = / g(w, x)p{dx] for g G L l {n). Shift pro- 
cesses abound in books on time series — for example, [2] and [16]. 

Next let Lq(tt) be the set of g G L 2 {tt) for which fy^gdir = 0; and, for 
g G Lq(tt), consider stationary sequences of the form = g(Wk) and their 
sums S n = X\ + • — h X n . Thus, 

S n = S n (g)=g(W l ) + --- + g(W n ). 

The question addressed here is the existence of a martingale M± , M2 , ■ ■ ■ 
with respect to T§,T\,J : 2i ■ ■ ■ having stationary increments and a sequence 
of remainder terms R±,R2, ■ ■ ■ for which \\R n \\ = o(y/n) and 

(1) S n = M n + R n . 

If (1) holds, we say that g admits a martingale approximation. Ever since 
the work of Gordin [10], martingale approximations have been an effective 
tool for studying the (conditional) central limit question and law of the 
iterated logarithm for stationary processes; see, for example, [3, 4, 20, 21], 
and their references for recent developments. The terminology here differs 
slightly from that of [20]. 

The sequence Xk = giWk) is said to admit a co-boundary if there is 
a stationary sequence of martingale differences dk and another stationary 
process for which 

Xk = dk + Zk — Zfs-i, 

for all k, in which case S n = M n + R n with M n = d\ + • • • + d n and R n = 
Z n — Zq. Here M n is a martingale and R n is stochastically bounded, but does 
not necessarily satisfy ||i? n || = o(y/n). Conversely, a martingale approxima- 
tion does not require R n to be stochastically bounded. The relation between 
co-boundaries and martingale approximations is further clarified by the ex- 
amples of [9]. 

Letting Q* denote the adjoint of the restriction of Q to L 2 (ir), so that 
{Qf-,9) = {fi Q*d) f° r f-,9 ^ L 2 (ir), Q is said to be a co-isometry if QQ* = I, 
in which case Q* is an isometry. Importantly, this condition is satisfied by 
shift processes. In Section 3, a convenient orthonormal basis for Lq(tt) is 
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identified when Q is a co-isometry, and a simple necessary and sufficient 
condition for the existence of a martingale approximation is given in terms 
of the coefficients in the expansion of g with respect to this basis. 
Returning to the main question, define 

n-1 

Vn9 = £ Q k g, 

k=0 

so that E(S n \F 1 ) = V n g{W l ). If (1) holds, then \\V n g\\ 2 = E[E(S n \Fi) 2 ] < 
2E(Ml) + 2E{R 2 n ) = o(n), and lining E(S 2 )/n = E(M 2 ). So, obvious nec- 
essary conditions for (1) are that 

(2) \\V n g\\ =o{y/n) 
and 

(3) \\g\\\ := limsup -E[S n (g) 2 ] < oo. 

n— >oo Tl 

Let C denote the set of g £ Lq(tt) for which \\g\\+ < oo. Then £ is a lin- 
ear space, and || • || + is a pseudo norm on C, called the plus norm below. 
Moreover, Q maps C into itself, since 

n 

(4) S n (g) = S n {Qg) + - Qg{W k - X )\ + Qg(W ) - Qg(W n ); 

k=l 

and, therefore, \\Qg\\+ < \\g\\+ + yfE{[g{W{) - Qg{W )\' 2 }. In Section 4 it is 
shown that g admits a martingale approximation iff (2) holds and 

1 m 

hm - Y^\\Q k g\\l = V. 

k=l 

These results are used in Section 5 to study the relationship between 
martingale approximations and solutions to the fractional Poisson equa- 
tion, g = — Q)h. The relation between martingale approximations and 
the conditional central limit theorem is explored in Section 6 with special 
attention to superpositions of linear processes. Section 2 contains some pre- 
liminaries. 

2. Preliminaries. In this section, upon exhibiting some preliminary facts, 
we establish a useful criterion for martingale approximations; and in partic- 
ular, we show martingale approximations are unique. Let 

r. = «±^=£(i-*y. 
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Then 

(5) E[S n (g) 2 ]=2n(g,V n g}-n\\g\\ 2 , 
from [2], page 219, and 

(6) V n = V n Q i + V t - -QV n Vi 

n 

for all n > 1, i > 1 by simple algebra and induction. Next, let tt\ denote the 
joint distribution of Wo and W±, define 

(7) H n (w ,wi) = V n g(wi) - QV n g(w ) 

and H n (wo,wi) = V n g(wi) - QV n g(w ) for wq,w\ G W. Then H n and H n 
are in L 2 (7Ti). 

Lemma 1. If (2) holds, then Sk = M nk + R nk where M nk = H n (W ,Wi) + 
\- H n (W k -i,W k ) and max fc < n || R nk \ \ =o(yfn). 

Proof. The lemma is almost a special case of Theorem 1 of [20]. Using 
(6) with i = 1, 

R nk = S k - M nk = QV n g(W ) - QV n g(W k ) + -S k (QV n g), 

n 

from which it follows that maxj.< n ||-Rnfc|| <■ 3maxj.< n which is o{^/n) 

by (2). □ 

Of course, M nk is a martingale in k for each n. The following proposition 
is closely related to Theorem 1 of [17]. 

Proposition 1. g € Lq{^) admits a martingale approximation iff (2) 
holds and H n converges to a limit H in L 2 (iri), in which case 

n 

(8) M n = M n {g):=Y J H{W k -i,W k ). 

k=l 

Consequently, martingale approximations are unique. 

Proof. Suppose first that g admits a martingale approximation, S n = 
M n + R n . Then (2) holds and S n = M nn + R nn , where ||i? ren || = o(y/n), by 
Lemma 1. So, 

nE{[H n (W , W x ) - M x ] 2 } = E[(M nn - M n ) 2 ] = E[(R nn - R n ) 2 } = o(n), 

implying the convergence of H n (Wo,Wi) in L 2 (P); and this is equivalent to 
the convergence of H n in L 2 (tt\). 
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Conversely, if (2) holds and H n converges to a limit H, say; we can let 
M n = H(W , W x ) + • ■ • + H(W n -i,W n ) and R n = S n - M n . Then (1) holds, 
R n = M nn - M n + R nn , and ||i? n || < y/n\\H n - H\\ + \\R n n\\ = o(y/n), estab- 
lishing both the sufficiency and (8). That martingale approximations are 
unique is then clear. □ 

Corollary 1. If g admits a martingale approximation, then so does 
Q k g, and Mx(Q k g) = H(W , Wx) - H k (W , Wi) with H k as defined in (7). 

Proof. For k = 1, this follows directly from (4); and for k = 2, 3, ... , it 
follows by induction. □ 

As a second corollary, we may obtain necessary and sufficient conditions 
for a linear process. Let . . . ,£-i,£oj£l) • • ■ be i.i.d. random variables with 
mean and unit variance; let do, oijflte, ■ •■ be a square summable sequence; 
and consider a causal linear process 

oo 

(9) Xj = "<v - = X! <s<- 

i=0 i<j 

Such a process is of the form X k = g(Wk), where W k = (..., £fc-i>£fe)- Letting 
6_i = 0, b n = ao + • • • + a n for n > 0, and using (9), 

n-2 

i<l i=0 

where the first term on the right-hand side is E(S n \W\). It follows that 

oo 

\\V n g\\ 2 = WEiSnlW^f = (h+n ~ h) 2 , 

i=-l 

also, V n g(W!) - QV n g(W ) = b n £ u and H n (W , Wx) = 6„6 with b n = (bx + 
• • • + b n )/n. Thus, for a linear process, (2) specializes to 

-, oo 

(10) lim - V (b l+n - h) 2 = 0. 

n^oo n * — ' 
i=— 1 

Corollary 2. For the linear process defined in (9), the following are 
equivalent: 

(a) There is a martingale approximation. 

(b) Equation (10) holds and b n converges. 

(c) Equation (10) holds andb\ converges. 
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Proof. In this case \\H n — H m \\ 2 = (b n — b m ) 2 . Hence, (a) and (b) are 
equivalent by Proposition 1. It is clear that (b) implies (c) and it remains 
only to show that (c) implies (b). If b\ converges, but b n does not, then 
b n would have to oscillate between two values, there would be a positive 
e for which |6 n +i — b n \ > e infinitely often; but this is impossible, since 
b n+ \ — b n = (b n +i — b n )/(n + 1) and b n = 0{y/n), as ao,a±, . . . are square 
summable. □ 

In the next section, we show how to extend this example from linear func- 
tions of shift processes to measurable ones with mean and finite variance. 

3. Co-isometries. We suppose throughout this section that the chain has 
a trivial left tail field and that Q is a co-isometry; that is, 

(11) lim ||Q n /ll =0 and QQ* = I 

n — >oo 

for all / G Lq(tt). We also suppose Lq(tt) is separable. These conditions are 
satisfied, for example, by (one-sided) shift processes. 

With a view toward later examples, we work with Jz? 2 (7r), the space of 
complex- valued, square integrable functions with mean under ir. Then (11) 
is still valid for this space if we extend the definition of Q to the imaginary 
part. 

Let TL denote a closed linear subspace of Jz? 2 (7r) that is invariant under 
both Q and Q*; restrict Q and Q* to W; and let K, = Q*TL. Then Q* is an 
isometry from H onto /C, since (Q*f,Q*g) = (f,QQ*g) = (f,g) for f,g£H. 
This is the origin of the term "co-isometry." Moreover, 

(12) Q*h(W 1 ) = h(W ) w.p.l 

for any h G Lg(vr), since E[Q*h(Wi)h(W )] = (QQ*h,h) = \\h\\ 2 by condi- 
tioning on W , and therefore, E{[Q*h(W x )- h(W )} 2 } = \\Q*h\\ 2 -2(QQ*h, h) 
+ \\h\\ 2 = 0. It can be easily checked (12) also holds for h G J&o(ir). 

Lemma 2. K, is a closed, proper linear subspace ofTC; and (XjLoQ* 3 ^- = 
{0}. 

Proof. That fC is closed is clear, since Q* is an isometry; and that K, is 
proper follows from ^LqQ^H. = {0}. So, it suffices to establish the latter. 
If / G C\^ =0 Q* j n, then there are ho, hi, . . . G H for which / = Q^hj with 
each j. In this case, \\hj\\ = \\f\\, since Q* is an isometry, hj = Q 3 Q* 3 hj = 
Q 3 f, and lirn^oo HQ^/II = 0. So, ||/|| = 0, establishing the lemma. □ 



Next, let lC ± = {feH:(f,h)=0 for all h G K}. Then K ± = {g^H:Qg = 
0}, since (Q*f,g) = (f,Qg) = for all / G H iff Qg = 0; and Q*Q is the 
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projection operator onto IC, since (Q*Q) 2 = Q*Q and Q(I — Q*Q) = 0. 
Let £q = {ej : j G J} be an orthonormal basis for /C -1 , let £, L = Q* 1 £q and 
£ = Ui>o Di- 
lemma 3. £ is an orthonormal basis for Ti.. 

Proof. £i consists of orthonormal elements for each i > 0, since Q* is 
an isometry; for any / G £{ and /' G where i < i' , there are e, e' G £o 
for which / = Q"e and f = Q"V, in which case (/,/') = {Q* l e,Q* 1 ' e') = 
{Cf^e, e') = 0, since Qe = 0. Finally, if / _L £ , then / G K and / = Q*/n for 
some /ii G Ti. If also, / _L Q*£o, then Q/ _L <?o, Qf = Q*h 2 for some hi G 
and / = Q*Qf = Q* 2 h 2 . Continuing, we find that if / _L £ , then / G 
for all j, and completeness follows from Lemma 2. □ 

Now write e^j = Q**ej , so that £i = {ej j : j G J} , and let TCj = span(ej j : i > 
0), the closed linear span of {e,j : i > 0}. Then = for each j, and = 
0j g jWj- In the language of [5, 11], the TCj, j G J, are an orthogonal invari- 
ant splitting of Ti. Then, any g GO. may be written as g = J2j&j X)i=o °i,j e i,j > 
where Cij are square summable. Let b n j = cqj + • • • + c n _ij, 6 nj - = + 
' " + b n j)/n and regard b n = (6 n j : j e J) and b n = (b n j'-jE J) as elements 
of £ 2 (J). 

Theorem 1. g G Lq(it) admits a martingale approximation iffh n con- 
verges in £ 2 {J), and 

oo 

(13) lim - Y] ||bj +n - bj|| 2 = 0. 

Proof. We take H = ^q(tt)- Since Qe^j = QQ* { ej = if i = and ej_ij 
if i > 1, Qg = Ej G jE 4 =i Cijei-ij, 

oo oo 

Q 9 = C i,j e i~k,j = c i+k,j e iji 

i=kj£j i=0j£j 

oo 

i=o je J 

and 

oo oo 
\\ V n9\\ 2 =^2^2\ b i+n,j ~ bi,j\ 2 =^2 W h *+n ~ h i\\ 2 ■ 

i=0jeJ i=o 
So (13) is just (2), specialized to the present context. 
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Next Q*Qg = EjgjX^i c i,j e i,j, so tnat from ( 12 )> 
ff(Wi) - Q<?(^o) = b " Q*<9<?](^i) = E cojeo,i(Wi), 

n— 1 , t s 

^n(W , Wi) = £ ( 1 - - ) [Q k 9(W!) - Q k+1 g(W )] = £ ^eoj(^i) 
fc=o V n/ jeJ 

and 

-f^n -f^m || — || t>j2 b m 1 1 . 

The theorem now follows directly from Proposition 1. □ 



Example 1 (Bernoulli shifts). The one-sided Bernoulli shift process is 
defined by 

oo 
3=0 

where . . . , £-i,£o;£ij • ■ • are i-i-d. random variables taking the values and 
1 with probability 1/2 each. The state space W is the unit interval, the 
marginal distribution tt is the uniform distribution, Qg(w) = ^[g(^w) + 
g{\w + 5)], and Q*g(w) = g(2w) for a.e. w G W and g G ^ 1 (tt) with the con- 
vention that 5 is continued periodically. For this example, any g G J2? 2 (7r) 
has a Fourier expansion 

(14) g = ^ Cr e r , 

where e r {w) = e 2mTW and c r , r G Z, are square summable. Then Qe r = 
or en /2) r accordingly as r is odd or even, and Q*e r = &2r for all r. With 
H = J2? 2 (7r), it follows that fZ, respectively K,- 1 , consists of all functions g for 
which c r = for odd, respectively even, r. Thus, <?o = span(e r : r G Odd), and 
£i = span(e r 2» : r G Odd), and there is an invariant splitting with aj = e^*- 
Necessary and sufficient conditions for the existence of a martingale ap- 
proximation can be read from Theorem 1. See [19] for more on the Fourier 
analysis of Bernoulli shifts. 

Example 2 (Lebesgue shifts). By a (one-sided) Lebesgue shift, we mean 
the Markov chain Wt = (..., Uk-i, Uk) where . . . , U-i, Uq, U\, . . . are inde- 
pendent uniformly distributed random variables over [0,1), in which case 
W = [0, 1) N and 7r = A N , where A is the uniform distribution. Lebesgue 
shifts are similar to Bernoulli shifts. Let T denote the set of sequences j = 
(jo, j\, . . .) G Z N for which jj = for all but finite number of i. Then, letting 
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j -w = jowo + jiW-i + • • • and ej (w) = e 2nl ^' w for w = (. . . , w~i, Wq) G [0, 1) N 
and j G F, any g G Jz? 2 (7r) has a Fourier expansion, 



c j e j 



jer 

where Cj are square summable. Next, let J = {j G T : j'q 7^ 0}. Then, since 



Qe, (to) 



■i -1 00 

/ e 2w du nexp(27r t j i Ti;_ i+1 ; 



£0 = {pk '■ k G J} is an orthonormal basis for /C -1 " [with TL = J2? 2 (7r) and /C = 
Q*H]- Define tp:T — > T by tp(j) = (0, jo, ji, . . .), then it is not difficult to 
check Q*ek = e^), Q* l ek = e^i(fc), where ^ is the composition of ip with 
itself i times. Necessary and sufficient conditions can be read from Theorem 
1. 

Example 3 (Superlinear processes). Let i G Z, j G N, be indepen- 
dent random variables, all having mean and bounded variances, for which 
. . . , £oj) £ij> • • • are identically distributed for each j, and let Cij, i G Z, 
j G N, be a square summable array. Then 

00 00 

(15) X k = r '-js/.- i,j 

j=0 i=0 

converges w.p.l and in mean square for each k and defines a stationary 
process. Letting ^ i = (£i,0j£i,i> • ■ •)> ^fc is of the form = ff(Wfc), where 
Wfc = (• ■ • >£fc-i>£fc) is a shift process. Next, letting W = span(£jj :i<0,j> 
0), one finds easily that there is an invariant splitting with e^j = £-i ? for 
i, 3 ' > 0- Necessary and sufficient conditions for the existence of a martingale 
approximation can again be read from Theorem 1. 

4. The plus norm. To study the plus norm, we first recall the definition 
\\g\\\ = limsupyj^oo E[S n (g) 2 ]/n. The following example serves as a simple 
illustration. 

Example 4. If Q is a co-isometry and the chain has a trivial left tail 
field, we may write g = X^o c M e «j> as m Section 3, and H n (Wo, W\) = 
J2jejbn,j e o,j(Wi) , as in the proof of Theorem 1. So, if (2) holds, E(S 2 ) = 
nE[H 2 (Wo, W\)] + o(n) = n||b„|| 2 + o(n), and \\g\\+ = limsup^oo ||b n || 2 . 

The main result of this section is that g admits a martingale approxima- 
tion iff ||V^<?|| = o(y/n) and Y^k=i \\Q k 9\\\ = o(m). The following two lemmas 
are needed; their proofs are given after the proof of Theorem 2. 
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Lemma 4. If g £ Lq(tt) and (2) holds, then 



lim 

n— >oo 



\H n — H„ 



— {Vn9,QV m g) 



m 



— (V m g,QV m g) 



m 



QV m g 



m 



Lemma 5. If g £ Lq(tt) and \\g\\+ <oo, then 

m 

limsup {V n g, QV m g) < \ £ \\Q k g\\ 2 + + \\\QV m g\\ 2 + (g, V m Qg); 

n— >oo , -, 

K = l 

and if g admits a martingale approximation, then the limit exists and there 
is equality. 

Theorem 2. g admits a martingale approximation iff (2) holds and 
(16) lim - Y,\\Q k g\\l = Q- 

m— >oo ui z — ' 



k=l 



Proof. Suppose first that g admits a martingale approximation. Then 
\\V n g\\ =o(y/n) and ]hn m -^ 00 \\im n -^ 00 \\H n - H m \\ 2 } = by Proposition 1. 
Next, by Lemmas 4 and 5, 

hm — (V^s, QVWs) 



lim I iJ n — 

n— >oo 



n — >oo 777 
m 



■ (KiS> QV m g) + 



in 



1 1 9 

- E 11^11 + + -\\QV m g\\ 2 + -{g, QV m g) 



k=l 



— {V m g,QV m g) 



m 



QV m g 



in 



Since 1 1 V^£? 1 1 = o(y / m), the last four terms on the right approach as m — > 
oo, and, therefore, so does the first. This establishes the necessity of (16). 

Next suppose that (2) and (16) hold; then lim m _ KX) [limsup n _ >00 \\H n — 
-ff m || 2 ] = 0, by Lemmas 4 and 5. It follows easily that sup n>1 \\H n \\ < oo, 
which implies H\,H2, ■ ■ ■ is weakly compact in L 2 (iri). Let H* denote any 
weak limit point of Hi,H2, .... Then \\H* — H m \\ < limsup n _ >00 \\H n — H m \\ 
for each m (cf. [8], page 68). Thus, linim^oo \\H m — H*\\ = from which the 
converse follows from Proposition 1. □ 



Proof of Lemma 4. To begin, write 



\H n — Hn 



\\{Vn ~ % 



\\Q(V n -V n , 



((I + Q)(V n - V m )g, (I - Q)(V n - V m )g) 



2( (V n - V m )g, 



QV m g QV n g 



m 



n 



QV m g QV n g 



in 



n 
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and when the first term in the last line is expanded, it becomes 

— (V n g,QV m g) - -(V n g,QV n g) - -(V m g,QV m g) + -(V m g,QV n g). 
m n m n 

The lemma now follows directly from (2) and the mean ergodic theorem, 
which implies that all those terms multiplied by 1/n approach as n — ► oo . 
□ 

Proof of Lemma 5. Writing 

m 

(V n g,QV m g) = Y / (Vng,Q k g), 
k=i 

and using (6), then 

m r 



{V n Q k g,Q k g) + (V k g,Q«g) - -{QV n V k g,Q k g) 

n 



(V n g,QV m g) = Y i 

k=l 
Here 

m m k 

E <h<7, Q fe <?) = E E KrV Q*s> 

k=l k=lj=l 

mm m 

= \ E Y,(Q 3 9> Q k a) - \ E \\Q j af + V m Qg) 

k=lj=l j=l 
m 

= \\\V m Qg\\ 2 -\Y.WQ j 9\\ 2 + (g,Vrr 

Combining terms together, 

1 

2 



(V n g,QV m g) = t ^[2(V n Q k g , Q h g) - \\Q k g\\ 2 } 



k=l 



1 m 1 

+ dl W„ff|| 2 + (9, V m Qg) - E -{QV n V k g,Q k g). 



k=i n 

The first assertion follows directly from (2) and (5). So does the second; for if 
g admits a martingale approximation, then the limit exists in the definition 
oi\\Q k g\\ + . □ 

5. The fractional Poisson equation. It is possible to attach a meaning to 
the symbol y/I — Q by replacing t with Q in the series expansion of y/1 — t. 
The definition may be written 

oo 

k 



k=l 
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where (3j. = (— l) k 1 ( 1 { 2 ) and the series converges in the operator norm, since 
Pk ~ l/(2 v / 7r/c 3/ ' 2 ) as k —> oo. A function h G Lq(tt) is said to solve the frac- 
tional Poisson equation (for g) if g = — Q)h. The relation between the 
existence of a solution to the fractional Poisson equation and the existence 
of a martingale approximation is considered in this section for co-isometries 
and normal operators (QQ* = Q*Q). 

Lemma 6. If g G y/JJ — Q)Lq(tt), then \\V n g\\ = o(y/n); and if g = 
^{I-Q)h=yJ{I-Q*)h*, then \\g\\\ = ({I + Q)h,h*) . 

PROOF. Observe that (/ - Q k )V n = (/ - Q n )V k . So, if g = y/(I-Q)h, 
then V n g = J2T=oflk{I — Q kWn )Vk/\nh, where A (V) denotes minimum (max- 
imum). Using the mean ergodic theorem, ||V^/i|| = o(n), then 

oo oo 

\\V n g\\<2j2(3k\\V kAn h\\=2j^p k o(kAn) = o(V^), 

k=0 k=0 

establishing the first assertion. If, in addition, g = ^/(7 — Q*)h*, then \\g\\ 2 = 
{(I-Q)h,h*), and 

(V n g,g) = ((/ - Q)V n h, h*) = (h, h*) - -{QV n h, h*) (h, h*), 

n 

using the mean ergodic theorem again in the final step. Thus, in view of (5), 
H5II4. = lim n _ >00 [2(t^ l g, g) — \\g\\ 2 } = ((I + Q)h,h*); similar calculations also 
appear in [7]. □ 

Normal operators. As an interesting generalization of [13] in the re- 
versible case, it is known [1, 6, 12] that if Q is a normal operator and there 
is a solution to the fractional Poisson equation, then g admits a martingale 
approximation. This result can be easily deduced from our Theorem 2. Re- 
call that if R is any bounded normal operator on a Hilbert space 7~i, then 
y/I — R and \Jl — R* have the same range (cf. [6], Lemma 2). 

Proposition 2. Suppose that Q is normal; then any g G >/(/ — Q)Lq(tt) 
admits a martingale approximation. 

Proof. If g G — Q]Lq(it), then (2) follows from Lemma 6, and it 
suffices to establish (16). Since the ranges of — Q) and — Q*) are the 
same, there are h, h* G Lq(tt) for which g = \/ (I — Q)h = — Q*)h* . Then 
Q k 9 = y/{I-Q)Q k h = V V - Q*)Q k h*, so that \\Q k g\\l = ((I + Q)Q k h, Q k h*) 
Thus, letting R = Q*Q, \\Q k g\\\ = ((I + Q)h, R k h*) , and it is necessary to 
show 

1 m 

(17) lim — Y ((I + Q)h,R k h*) = 0. 

v ' m->oo 771 ^ xv ' ' ' 

fc=l 
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To see this let 1Z be the closure of (I — R)Lq(tt). Then 1Z 1 - consists of all / 
for which Rf = f, and Q, Q*, and R map both 1Z and TZ 1 - into themselves. 
Write h = h 1 + h 2 with hi G TZ, h 2 £ll ± , and let g { = - Q)hi. Then 
gi^TZ and g 2 G TZ , since Q maps 7?. and 7£ into themselves. Next, write 
fr* = h* + h 2 with /ij (zlZ,h 2 (z TZ^; then # = ^/(J - Q*)h* by the uniqueness 
of direct sum decomposition of g. Returning to (17), we have 

<(/ + Q)h, R k h*) = {(I + Q)hi, R k h\) + ((J + Q)h 2 ,h*) 

= ((I + Q)h 1 ,R k h* 1 ) + \\g 2 \\l 

by orthogonality and Lemma 6. It will be first shown that ||<?2|| + = 0; to see 
it, note Rg 2 = g 2 , then 

n— In— 1 n— 1 

\\v n92 \\ 2 = 2Y / Y,(Q 3 92,Q k 9 2) - E WQ J 92\\ 2 

j=0 k=j j=0 
n-1 

= 2 ^2(92,V n -jg 2 ) -n||# 2 || 2 

= n[2(g 2 ,V n g 2 ) - \\g 2 \\ 2 }, 

thus, H52II+ = follows from (5) and Lemma 6. That (17) holds when h* G 
(I — R)Lq(tt) is clear by forming a telescoping sum, and the boundary case 
then follows by approximation. □ 

Co-isometries. The existence of a solution to the fractional Poisson equa- 
tion does not imply the existence of a martingale approximation for co- 
isometries. Here is a simple example. 

Example 5. Let . . . , £-i,£o>£i> ■ • ■ be i.i.d. with mean and unit vari- 
ance; consider the shift process Wk = (■ • ■ , For j > 0, let aj = 
l/[V(j + l)log(j + 2)] and define h by 

00 

MWo) = 

3=0 

so that hiyVk) is a linear process. Then g = — Q)h admits a solution to 
the fractional Poisson equation, and 

00 00 
g(W ) = £ 0k(I ~ Q k )KW ) = £ c^-3 

k=l j=0 

with 

00 

c i = ^2Pk(aj - a j+k ), 
k=i 
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after some straightforward calculation. Observe that dj — aj+k > for all 
j > and k > 1, and that dj + k < 3ay/4 for all k > j + 1 and all j > 0. So, 



2 oo 



for all sufficiently large j. Therefore, b n = cq + • • • + c n — ► oo, and also, its 
Cesaro average 6 n — > oo as n — > oo. No martingale approximation can exist. 

However, the existence of solutions to both the forward and backward 
fractional Poisson equations does imply the existence of a martingale ap- 
proximation. 

Proposition 3. Suppose Q is a co-isometry and the chain has a trivial 
left tail field, and if g G y/lj — Q)Lq(it) n — Q*)Lq(tt), then g admits a 
martingale approximation. 

Proof. As in Section 3, we can take TL = ^f 2 ( 7r )) an d there is an or- 
thogonal invariant splitting, TL = ®j^jTij. Let g = \/(I — Q)h for some 
h£TL, g = J2jej9ji an d h = J2jejhj with gj,hj G TLj for all j. Clearly 
g = J2jeJ V(I ~ Q)hj and, therefore, gj = y/(I — Q)hj, by taking the pro- 
jection on each TLj. Similarly, g = yJT— Q*)h* , where h* = J2j£jhj with 
h* G TLj , and gj = \/(I — Q*)hj for each j . It then follows easily from Lemma 
6 and Example 4 that lim n ^ oc |6 n ,j| 2 — = ((I+Q)hj, hj) exists for each 

j and that limn^oo ||b n || 2 = \\g\\+ = ((I + Q)h, h*) exist. It then follows from 
(the proof of) Corollary 2 that bj = limn-^ b n j exists for each j, so that b n 
converges weakly to b = (bj :j G J). So, to show convergence of b n in the 
norm of £ 2 (J) and, therefore, the existence of a martingale approximation, 
it suffices to show that linin^oo ||b n || 2 = ||b|| 2 ; and this follows easily from 
Lemma 6 which implies 



lim ||b n || 2 = ((I + Q)h, h*) = E(( J + Q)hj,hj) = E \ h i? = H b l 



2 



+oo ■ ' — ' ' - J ■ ' — ■ ■ " ■ I — I 

jeJ jeJ u 

6. The CCLT for superlinear processes. Let F n denote the conditional 
distribution function of S n j 'y/n given Wq, 

Sn 



F n (w;z)=P 



< z 
n 



Wq = W 



We will say that the conditional central limit theorem (CCLT) holds (with 
a sjn normalization) iff 

lim ^l = K 2 G[0iOo) 

n— >oo n 
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and 



lim / d[$ K ,F n (w;-)]ir{dw} = 0, 



where <E> K denotes the normal distribution function with mean and stan- 
dard deviation k, and d is the Levy metric or any other bounded metric that 
metrizes weak convergence of distribution functions. 

It is clear that the existence of a martingale approximation implies the 
CCLT; see, for example, [15]. It is also clear, for simple linear process as 
defined in (9), CCLT necessarily requires the existence of martingale ap- 
proximation. However, in general, the converse is not true as shown in the 
example below. To proceed as in Example 3, let Fj be the common dis- 
tribution function of i = . 1,0, 1, . . . and suppose that the Fj have 
mean and bounded variances. Recall the notation b n j = cqj + • • • + c n _ij 
and b n> j = (pxj + • • • + b n; j)/n and that b n = (b n ,i, b n> 2, ■ • •) and b n may be 
regarded as elements of i (N). 

Example 6 (Super linear process revisited). Consider a superlinear pro- 
cess, defined in (15), with Cij = for all j > 2, b n fl = cos(\/logn), b n ,i = 
sin(vTogn), and cqj = c\j = for j = 0, 1. Then c nj - = b n j — & re -i,j = 
O(l/(ny/\ogn)) for j = 0,1. So, the process is well defined. If Fq and F\ 
both have mean and unit variance, then the CCLT holds, but martingale 
approximation does not exist. To see this, first observe that for any 5 > 0, 

Y^(h+n,o ~ b k ,o) 2 < + )[cos(y / log(n + A;)) - cos( ^log k)} 2 



k=0 \k<nS k>nSS 

< 4n5 + ^2 

k>nS 



11 



2fcy / I^gfc 



so that Efclo( & fc+n,o - h,o) 2 = o(n), and similarly, Efclo( & fc+n,i ~ h,i) 2 
o(n). So, IIV^^H 2 = o{n). Next, for any e > 0, 



1 « 

o = -^[cos(v^ogfe) -cos(Vlogn)] 



n k=l 



< — [cos(Vlog k) - cos(Vlogn)] + — V" [^/logn - \/logk] 

k<ne ne<k<n 
1 v-^ n — k 1 . , 1 

<2e + - > - n <2e + - (n-ne) ; = 

for all large n. It follows that b n fl — b n fl = o(l). Similarly b nt i — b n> i = o(l), 
and therefore, 6 2 + b^ ll — ► 1. So, applying Theorem 2 of [20], CCLT holds; 
but martingale approximation does not exist since b n j does not converge 
for j = 0,1. 
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Next, we investigate some partial converses for superlinear processes. 

Theorem 3. If the CCLT holds for all choices F\, F2, . . . with means 
and unit variances, then h n is pre-compact in £ 2 (N); and if the CCLT holds 
for all F\,F2, ■ ■ ■ with means and bounded variances, then h n converges in 
t 2 {N). 

Proof. If the CCLT holds, then (2) holds by Corollary 1 of [15]. So, by 
Lemma 1, S n = M nn + R nn , where ||i2 nn || = o(y/n) an d 

00 

5=1 

where ( n j = £ij H \-£n,j- So, if the CCLT holds for any choice of F\, F2, ■ . . 

with means and unit variances, then limn^oo ||b n || 2 = k, 2 . In particular, 
b n , n > 1, are bounded and, therefore, weakly pre-compact. To show pre- 
compactness, it thus suffices to show that any weak limit point is a strong 
limit point. Let b E £ 2 (N) be an arbitrary weak limit point and let No be a 
subsequence for which lim ne N b n = b. Then lim ne N b n ,j = bj for all j, and 

jn 

neNo " 
J=l 

for some subsequence j n — > 00. By thinning the subsequence No, if necessary, 
we may suppose that j n , n G No are strictly increasing. There is a strictly 
decreasing sequence 1 > q\ > 52, • • ■ for which lim n€ N nqj n = 0. Let pj = 
qj — qj + \ and let Fj be the distribution which assigns mass \p^ to ±l/y/pj 
and mass 1 — pj to 0. With this choice of 2*i, -F2, • • • , let 

jn 

-^Ln,n — ^ b n j(^ n j. 
i=i 

Then P[Cn,j 7^ 0] < n Vj-> an d 

P[M re , n / M re , n ] < nq jn -> 

as n — > 00 in No- So, M n ^ n j \fn has a limiting normal distribution with mean 
and variance re 2 and, therefore, 



and 



Jn -1 

hminf^^ = limuif -E(M 2 ) > k 

nGN ^— ' ' J n€N n 
J=l 



hm 6„ ,■ 

J=Jn + l 



2 
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It follows easily that lim ng N 

b n = b in £ 2 (N), and since b was an arbitrary 
weak limit point, this establishes the first assertion. 

The second assertion is now immediate. Setting all of the variances but one 
to zero shows that linin^oo 6 2 • exists for a fixed j, in which case linin^oo b n j 
exists, since — b n j\ = 0(y/n), as in the proof of Corollary 2. It then 

follows that b n converges weakly, from which the assertion follows since b n , 
n > 1, are pre-compact. □ 
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